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ABSTRACT 

This study examined impact of a staff development 
program on increasing the accuracy of teachers' self-evaluation of 
classroom performance. Teachers were provided with specific formal 
feedback through a program called The Effective Use of Time Program 
(EUOT). The program had four components: (1) observation in the 
classroom and feedback about performance; (2) information from 
research applied in the context of a teacher's specific situation; 
(3) opportunities for guided practice; and (4) observation and 
feedback following workshops to assess improvement. To test EUOT, 
data from 40 elementary, junior high, and secondary teachers were 
examined. These observations, using the Stallings Observation 
Instrument (SOI), provided a message of actual teecher performance. 
Four variables were selected for comparision from self-rating and 
observation data: (1) managerial and organization efficiency; (2) 
student discipline; (3) interactive instruction; and (4) monitoring. 
Results showed that teachers improved their actual performance and 
gave themselves higher ratings at the end of the program. In general, 
teachers were no more accurate in assessing their performance after 
training, although junior high teachers showed significant 
relationships between postt raining self-ratings and observed 
behavior. Several explanations are given for failure of data to show 
wider improvements in accuracy of self-assessment, and five tables 
are included to show results. (LMO) 
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IMPROVING THE ACCURACY OF TEACHER SELF-EVALUATION 
THROUGH STAFF DEVELOPMENT 

In order to Improve their instructional effectiveness, teachers 
need information about their classroom performance. Such information 
comes from a variety of sources. These sources include formal 
evaluations, usually conducted at the building level by the principal, 
informal feedback from teaching colleagues, and the teacher's own 
experience with students and self-perceptions of the effectiveness of 
their performance. 

The problem is that these sources generally do not provide much 
relevant and useful information to help teachers assess and improve 
their teaching performance. The usual approach to formal evaluation 
is for the buillding principal to complete a checklist type form 
Indicating impressions of certain teacher characteristics or mastery 
of certain skills that may have little relationship to promoting 
student learning (Weisenstein 1976; Hawley & Rosenholtz 1984). These 
evaluations occur Irregularly and infrequently (Dreeben 1970; 
Dombusch & Scott 1975; Natriello & Dornbusch 1980-1981) and leave 
teachers with little sense of the effectiveness of their performance 
or of the steps they need to take for improvement (Lortie 1975; 
Natriello & Dornbusch 1980-1981; Natriello 1984). (1) 

Informal collegial evaluation and feedback may be one of the most 
potentially productive sources of information to improve teacher 
practice (Little 1982; Fullan 1982; Rosenholtz & Smylie 1984). 
However, collegial feedback about performance is rare in most schools 
and is restricted by the physical isolation of teachers and norms of 
^ autonomy (Griffin 1983). For example, Lortie (1975) found m his 



sample of elemencary and secondary school teachers that 45Z reported 
no contact with other teachers during the course of the workday and 
only 32% reported having occasional contact (see also Tye & Tye 1984). 
Glidewell and his colleagues (1983) identified autonomy as comething 
of a moral imperative among teachers in their study. These teachers 
felt constrained against offering suggestions about even the most 
routine matters to other teachers in their schools. 

In the absence of relevant and useful feedback from formal and 
collegial evaluation, most teachers are left to rely on 
self-evaluation of their classroom experiences (see Buchmann & 
Schwille 1983; Rosenholtz & Smylie 1984). As measured by 
self-report c, teachers' percept|.ons generally do not provide accurate 
assessments of their actual performance (Hook & Rosenshlne 1979; Jones 
1982; Wheeler & Knoop 1982). Without being able to accurately assess 
their own performance, indeed, ;without constructive feedback from 
external sources, teachers arejplaced in a position of reacting by 
trial and error to situations that do not go as planned or to 
classroom crises. 

The purpose of this study is to examine the Impact of a staff 
development program on increasing the accuracy of teachers' 
self-evaluations of their classroom performance. The program. The 
Effective Use of Time Program, provides teachers with specific formal 
feedback about their teaching and presents a variety of opportunities 
for teachers to experiment with new classroom strategies and to 
informally assess and discuss their experiences in an interactive 
collegial environment. It is hypothesized that this program will help 
teachers become more aware of their behavior and increase the accuracy 
of their se? f-assessments of classroom performance. 
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Description of the Staff Development Proi^ram 
The Effective Use of Time Program (EUOT) Is based on a 
four-component accountability model for staff development (Stalllngs , 
1985). In the first component, teachers are observed in their 
classrooms and provided detailed objective feedback about their 
performance. Areas of deficiency are identified and teachers are 
assisted to set their own individual goals for improvement. The 
second component is designed to provide teachers with information from 
research findings on effective teaching. These findings are presented 
m the context of broader theory of instructional practice and linked 
to the individual teacher's specific classroom situation. The third 
component allows opportunities for guided practice. Here, teachers 
take research findings and different instructional strategics provided 
by other teachers and, under the guidance of the workshop leader and 
with the assistance of teachers in the workshop group, work to adapt 
and experiment with them according to the teacher's own teaching style 
and classroom context. Within the group, teachers assess and discuss 
their experiences with implementing new strategies. Further, each 
teacher is provided additional feedback about their performance from 
peer observations. In the fourth component, after the workshops 
conclude, teachers are again observed in their classrooms and provided 
the same types of objective feedback presented at the beginning of the 
program to assess their levels of improvement. 

The program consisV.s of six workshops. The first workshop is 
devoted to presentation of general research findings and discussion of 
pretralning observational djita. In the sixth workshop, teachers are 
provided posttrainlng feedback about the changes they made during the 
course of the program. The other four workshops focus on strategies 
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to improve classroom management, student discipline, lesson 
development and implementation, and interactive instruction and 
monitoring independent student work. The goal is to provide teachers 
with methods that will help them immediately in the classroom to use 
their time and their students' time in academically-productive ways. 

Each workshop group is headed by g certified trainer who serves 
as a facilitator of discussion and experimentation among teacher 
members. The teachers themselves are encouraged to serve as resources 
and advisors for one another. To encourage discussion and to build a 
sense of trust and confidence among teachers in the group, membership 
is limited to six to eight teachers. To make that discussion aore 
relevant to participants, workshop groups are structured to include 
teachers of similar grade levels (e.g. elementary, junior high/middle 
school, secondary) and subject areas (e.g. academic as opposed to 
vocational education or fine arts). Finally, to provide teachers time 
to experiment with new strategies and reflect upon their experiences, 
workshop sessions are scheduled one to two weeks apart. 

It seems likely that various aspects of this program could serve 
to increase teachers' abilities to accurately evaluate their own 
performance. First, teachers are provided with detailed objective 
data about their actual classiToom performance. And, they are able to 
compare their performance to research findings that suggest ranges of 
effective levels of behavior (for a description of these levels, see 
Stallings 1985; Simons 1985). Second, teachers are encouraged to 
examine their own practice in light of their specific classroom 
situations to determine how different strategies might or might not 
apply. These assessments are made in the interactive context of the 
work group. Third, workshop activity pivots on discussion of 
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strategies teachers currently use, experimentation with new ideas, and 
assessments of teachers' experiences putting those new ideas into 
practice. Participants commit to try new ideas, return to the 
classroom to implement them, and then report the results back to the 
group. Each teacher with other group members discuss successes and 
failures and try to determine why certain outcomes may have resulted. 
Finally, the opportunity to conduct peer observations provides 
additional feedback to the teacher being observed about clasroom 
performance. Further, and of equal importance, these observations put 
teachers in a position to reflect upon their practice, as they observe 
their colleagues. 

Methodology 

To test whether the EUOT Program serves to increasa the accuracy 
of teachers' self-evaluation of their classroom performance, data were 
examined from 40 elementary, junlot high/middle school, and secondary 
teachers who participated in the program between 1982 and 1984.(2) 
Each teacher completed a performance self-rating form during the first 
workshop before they received feedback from their classroom 
observations. During the sixth and final workshop, these teachers 
completed the same self-rating form before they received feedback from 
their posttrainmg observations. The form asks teachers to asoess 
their performance in various one-item categories on a scale of 1 to 4 
where 1 = Needs Improvement and 4 ■ Very Effective. 

Classroom observation data provide a measure of actual teacher 
performance. These data were collected during three classroom 
observations before training and three classroom observations after 
training with the Stalllngs Observation Instrument (SOI). The SOI 
provides data for both teachers and students on proportions of time 
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spent in and proportions of interactions related to classroom 
organization and management, student discipline, interactive 
instruction and monitoring (see Stallings & Geisen 1977 for c detailed 
description of this Instrument, its validity and Its reliability). 
Proportions of time spent in various activities were derived from five 
short scans of the classroom equally spaced throughout the class 
period* In all, over the course of these observations, 15 samples of 
activity were recorded. Classroom interactions were coded at 
virtually the speed of speech during five timed 5-minute periods, also 
equally spaced across the class period* During the three classroom 
observations between 750 and 900 Interactions for each teacher were 
recorded. For the purpose of this study, we rely as much as possible 
on interaction data as opposed to the activity data collected from 
scans* We do so because the volume of data points about interactions 
are greater and provide a more stable data base for analysis. 

Four variables were selected for comparison from both self-rating 
and observation data. Teachers* self-ratings on managerial and 
organization efficiency were matched with the proportion of all 
observed statements that dealt with management and organization. 
Their self-ratings on student discipline were matched with the 
proportion of all observed statements related to student beh^ivior. 
Self-ratings on interactive instruction were matched with the 
proportion of observed statements that were academic. Finally, 
teacher self-ratings on monitoring were matched with the difference 
between the observed proportions of time students spent doing seatwork 
and the teacher spent monitoring that seatwork. We chose to represent 
the observed monitoring variable this way to account for the differing 
amounts of seatwork teachers assigned to their students. Interaction 
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data would not provide this distinction. 

The observational variables had to be adjusted to reflect levels 
of relative effectiveness so that they aight be compared to the 
teachers* self-ratings of effective performance. To oake this 
computational adjustment, individual scores on each of the first three 
observational variables were subtracted from criterion scores 
established in previous research (Stallings, Cory, Fairweather, & 
Needels 1978). These criterion scores represent levels of performance 
significantly related to student achievement (Stallings et al. 1978; 
Stallings 1980). For classroom organization and management, the 
criterion is 15Z or less of all observed statements. For student 
discipline, the criterion is 3Z or less of all statements. For 
interactive instruction, the criterion is 80Z or more of all 
statements. t 

Thus, in order to show relative levels of effective performance, 
teachers* observation scores for classroom management were subtracted 
from 15Z. Teachers' observation scores for student discipline were 
subtracted from 3Z. Finally, teachers' scores for instruction were 
subtracted from 80Z and then converted to absolute values to indicate 
proper direction with respect to the criterion level. In this way, 
low adjusted scores represent low levels of effective performance and 
high adjusted scores represent high levels of effective performance 
(Thieme-Busch & Prom 1983). 

Levels of effective monitoring were computed by subtracting the 
proportion of time students spent doing seatwork from the proportion 
of time teachers spent monitoring that seatwork. The working 
assumption here is that academirdlly effective teachers do not attend 
to other duties while their students work independently. Instead, 



they actively monitor that activity to help keep students on-task and 
correct any errors students «ay be making (Stalllngs 1980). Thus, 
higher scores on this adjusted measure indicate that teachers are 
involved more in monitoring their students' seatwork than teachers 
with lower scores. 

Means and standard deviations were calculated and one-tall 
T-tests were computed for each of the four variables from 
self-ratings and adjusted observation scores both before and after 
training to indicate directions and significance of change* Then, 
analyses of variance were conducted to test whether teachers were mor€ 
accurate in assessing their own behavior after training than before 
(Nie, Hull, Jenkins, Stelnbrenner & Bent 1975). It was anticipated 
that the relationship between the variance in post training 
self-ratings and posttralnlng observed classroom performance would be 
more significant than the relationship between the variance of 
pret raining self-ratings and observed performance. 

Analyses were conducted for classroom organization and 
management, student discipline. Interactive Instruction, and 
monitoring to determine If teachers' were more accurate in assessing 
their own performance in some areas but not others. And, analyses 
were conducted on subsamples of the 40 teachers to test whether 
elementary, junior high/middle school, or secondary teachers might be 
better self-evaluators. 

Results 

Pret raining and postt raining means for self-ratings and adjusted 
observation scores are presented in Table 1. Changes in these neans 
suggest that overall, teachers improved their actual performance and 
gave themselves higher ratings at the end of the program. (3) However, 
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few of these changes were statistically significant. 

Analyses of variance indicate that in general the teachers were 
no more accurate in assessing the effectiveness of their clasijrooB 
performance after training than before. Results shown in Tables 2, 3, 
4, and 5 reveal insignificant relationships between ^elf-ratings and 
observed behavior both before and after training in all four areas of 
performance. Insignificant relationships were found for teachers in 
the total sample and for subsamples of elementary, junior high/middle 
school, and high school teachers. 

There are several exceptions. Significant relationships were 
found between posttraining self-ratings and observed behavior for 
junior high/middle school teachers in the areas of classroom 
management (^-.026) and interactive instruction (p«.044) (see Tables 2 
end 4). Significant relationships were also found between 
posttraining self-ratings and observed performance in the area of 
interactive instruction (p-.007) and between pretraining and 
posttraining self-ratings and observed performance in the area of 
monitoring (p-»001; p».033) for the total sample (see Tables 4 and 5). 

Discussion 

Teachers assess the effectiveness of their performance in lar^e 
part by the performance of their students. Evidence exists that 
influence in classroom interaction is bidirectional (Fiedler 1975; 
Brophy & Good 1974). The teacher acts; students respond; the teacher 
uses student responses to evaluate the effectiveness of the action and 
determine how next to proceed (see also Green 1983). 

This staff development program requires that teachers experiment 
with new ideas and strategies in the classroom and study their 
experiences. Such experimentation introduces change in routine for 
O 9 

ERJC 1, 



both teachers and students. How students respond to the change that 
is introduced will indicate to the teacher the effectiveness of that 
change. The stronger the student response, either positive or 
negative, the stronger the message to the teacher about his or her 
perf omiance. 

Indeed, it is likely that teachers' ability to accurately assess 
their own performance is related to the magnitude of student reaction. 
One would anticipate that teachers of more reactive students would be 
more aware of their own behavior. And, there is some evidence to 
suggest that secondary students, and particularly junior high 
students, are more reactive than elementary students (see e.g., 
Fiedler 1975). This phenomenon may help explain why significant 
relationships between posttraining self-ratings and observations were 
found for junior high/middle schol teachers but not for elementary and 
high school teachers. 

Fail ure of the data to show wider improvements in the accuracy of 
teachers' self-assessments may be due to a variety of other factors as 
well. First, the self-rating instrument may not be sensitive enough 
to assess finer gradations in teachers' perceptions of the 
effectiveness of their performance. Second, the specific feedback, 
discussion of individual practice, and presenLdCion of research 
findings about effective teaching may alter teachers' frames of 
reference, raise their standards for effective performance, and make 
them more self-critical of their own behavior. 

Third, it is possible that over the course of the workshops, as 
teachers discuss their individual situations, they indeed become more 
accurate in assessing their own performance. But those assessments 
may be more precise in relation to the specific contexts of their 
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Individual classrooms Instead of in relation to broader sets of 
performance criteria used in the program and for this analysis. This 
raises Important questions about the applicability of criteria 
developed from studies of teachers In one context (StalUngs et al. 
1978) to other populations of teachers in different contexts. 

Finally, even though the staff development program provides a 
great deal of specific feedback about Individual practice and 
perfonaance. It does not offer a systematic set of strategies for 
teachers to use to assess their own performance. The presence of such 
strategies seems to be key In those few studies that do find 
significant relationships between self-assessments and measures of 
actual performance (see Irvine 1983; Newfleld 1980). 



Notes 

!• More productive, interactive evaluation processes have been 
identified in studies of effective schools and of effective evaluation 
and staff development programs (see e.g., Wise, Darling-Haamond, 
McLaughlin, & Bernstein 1984; Azumi & Madhere 1983; Wynne 1980; 
Wellisch, MacQueen, Carriere, & Duck 1978; Brookover & Lezotte 1979; 
Good & Grouws 1979; Stallings 1980). While this research adds to the 
body of evidence about more effective ways to help improve practice, 
these processes seem to be exceptions rather than the rule in most 
school districts. 

2. This sample includes all teachers in eight workshop groups held in 
California and Tennessee for whom complete data are available. 

3. It should be noted that the large differences between the 
pretraining and posttraining adjusted monitoring scores for eleaentary 
teachers and the pretraining and posttraining monitoring scores for 
the other subsatnples of teachers is probably due to greater amounts of 
small group work in elementary classrooms. Elementary teachers are 
more likely to assign independent seatwork to one group and then move 
to another group for instruction th^n junior high/middle school or 
high school teachers (Stallings 1980). For this reason^ the amount of 
time students spend doing seatwork may be greater than the time their 
teachers spend monitoring that work. 
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TABLE 1. Means and Standard Deviations for Pretraining and Posttraining Self-Ratings and Adjusted 
Observation Scores. " 



Self-Ratings 



Adjusted Observation Scores 



Pretraining X Posttraining X Change 
(SD) (SD) 



Orp,anlgation/ManaRenient 
Total (N = AO) 

Elementarx (N = 13) 



Junior High /Middle 
(N = 12) 

Secondary (N = 15) 



Discipline 
Total (N = AO) 

Elementary (N = 13) 



Junior High /Middle 
(N = 12) 



Secondary (N = 15) 



2.3750 
( .7048) 

2.0769 
( .8623) 

2.6667 
( .4924) 

2.4000 
( .6325) 



2.A750 
( .9334j 

2.3077 
( .8549) 



3.0000 
( .7385) 

2.2000 
(1.01A2) 



2.8750 
( .6A80) 

2.615A 
( .7679) 

3.1667 
( .3892) 

2.8667 
( .6399) 



2.8750 
( .7906) 

2.6923 
(1.0316) 



3.2500 
( .6216) 

2.7333 
( .5936) 



+ .5000 ** 
+ .5385 
+ .5000 
+ .A667 



+ .4000 
+ .38A6 

■f- .2500 
+ .5333 



Pretraining X Posttraining X Change 
(SD) (SD.) 



- 2.1500 
(8.AA76) 

• .1538 
(8.20A1) 

• .8333 
(6.3509) 

• 4.9333 
(9.79A1) 



.0000 
(2.9352) 

• .7692 
(4.0A46)' 



• .6667 
(2.A985) 

1.2000 
(1.6125) 



2.1750 
(7.0707) 

5.38A6 
(3.52A6) 

1.5833 
(6.5291) 

• .1333 
(8.9192) 



.9750 
(1.7757) 

.6923 
(2.1364) 



.5000 
(2.0226) 

1.6000 
( .9856) 



+ A. 3250 
+ 5.5385 
+ 2.4167 
+ A. 8000 



+ .9750 
+ 1.4615 

+ 1.1667 
+ .4000 
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TABLE 1. Means and Standard Deviations for Pretraining and Posttraining Self-Ratings and Adjusted 
Observation Scores (continued). 



Be If-Ra tings 



Adjusted Observation Scores 



Pretraining X 
(SD) 



Posttraining X Change 
(SD) 



Pretraining X Posttraining X Change 
(SD) (SD) 



Interactive Instruction 
Total (N = 40) 

Elementary (N = 13) 



Junior High/Middle 
(N = 12) 

Secondary (N = 15) 



Mcnitoring Seatvork 
Total (N ' 40) 

Elementary (N = 13) 



Junior High/Middle 
(N = 12) 

Secondary (N =« 15) 



2.7250 
(1.3202) 

2.1538 
( .8987) 

2.5833 
( .7930) 

3. 3333 
(1.7182) 



2.7000 
( ,7860) 

1.7500 
( .6220) 

2.6667 
( .6513) 

2.6429 
( .7450) 



3.1250 
( .9111) 

2.6154 
(1.1929) 

3.5000 
( .5222) 

3.2667 
( .7037) 



2.9000 
(1.0080) 

2.1667 
(1.1930) 

3.1667 
( .7177) 

3.2857 
( .7260) 



+ .4000 
+ .4615 
+ .9167 ** 
- .0667 



+ .5263 * 



+ .4167 



+ .5000 



+ .6429 



-- 1.5500 
(9.9870) 

- .3077 
(11.3606) 

- .9167 
(8.0731) 

- 3.1333 
(10.5618) 



- 8.5500 
(9.7690) 

- 14.6923 
(12.9640) 

- 6.0000 
(6.2377) 

- 5.2667 
(6.2503) 



4.6750 
(7.5018) 

7.6923 
(5.1216) 

4.3333 
(8.2719) 

2.3333 
(8.1299) 



- 9.3000 
(13.0839) 

- 17.3077 
(17.9786) 

- 2.9167 
(3.5022) 

- 7.4667 
(9.5981) 



+ 6.2250 ** 
+ 8.0000 
+ 5.2500 
+ 5.4667 



- .7500 



2.6154 



+ 3.0833 



- 2.2000 



* p < .05 
** p < .025 



TABLE 2. Analyses of Variance for Repeated Measures Sunmary for Observed Manap.ement and Organization 



Sources of Variation 



Pretraini.ng 



df MS 



Posttraining 



df MS 



Total 

Pretraining Self-Rating 
Residual 

Posttraining Self-Rating 
Residual 

Elementary 

Pretraining Self-Rating 
Residual 

Posttraining Self-Rating 
Residual 

Junior High/Middle 



3 50.86 .696 .561 
36 73.07 



3 102.09 1.832 
9 55.71 



.211 



3 
36 



3 
•9 



22.81 
52.26 



7.16 
14.18 



.436 .728 



.505 .689 



Pretraining Self-Rating 
Residual 

Posttraining Self-Rating 
Residual 

Secondary 

Pretraining Self-Rating 
Residual 

Posttraining Self-Rating 
Residual 



1 12.04 
10 43.16 



2 
12 



55.04 
102.74 



.279 .609 



.536 .599 



1 
10 



2 
12 



190.82 6.861 .026 
27.81 



7.49 
91.56 



.082 .922 



TABLE 3. Analyses of Variance for Repeated Measures Summary for Observed Student Discipline 



Pretraining 



Post training 



Sources of Variation 



Total 



df MS 



df 



MS 



Pretraining Self-Rating 
Residual 



3 4.93 .552 .650 
36 8.92 



Posttraining Self-Rating 
Residual 

Elementary 



3 
36 



2.17 
3.24 



.572 .575 



Pretraining Self-Rating 
Residual 



20.19 
15.09 



1.336 .323 



Posttraining Self-Rating 
Residual 

Junior HlRh/Middle 



3 
9 



2.30 
5.32 



.433 .735 



Pretraining Self-Rating 
Residual 



1.33 
7.33 



.182 .837 



Posttraining Self-Rating 
Residual 

Secondary 



2 
9 



7.27 
3.39 



2.1A7 .173 



Pretraining Self-Rating 
Residual 



3 
11 



3.51 
2.35 



1.493 .271 



Posttraining Self-Rating 
Residual 



2 
12 



.20 
1.10 



.182 .836 





TABLE 4. Analyses of Variance 


t 

for Repeated Measures Summary for Observed Interactive Instruction 




1 

• 








Pretralning Posttraining 








Sources of Variation 


df 


MS F p df 


MS F 


P 






Total 














Pretralning Self-Rating 
Residual 


3 


54.46 .518 .673 
105.21 










Posttraining Self-Rating 
Residual 




3 
36 


205^99 4.703 
43.80 


.007 






Elementaxry 














Pretralning Self-Rating 
Residual 


3 

Q 

7 


99.15 .713 .568 
.1 jy .u^t 










Posttraining Self-Rating 
Residual 




3 
9 


14.90 .496 
30.01 


.694 






Junior HiRh/Middle 




1 








■ 


Pretralning Self-Rating 
Residual 


2 

0 


138.45 2.832 .111 , 
48.89 ' 










Posttraining Self-Rating 
Residual 




1 
10 


261.33 5.319 
49.13 


.044 






Secondary 














Pretralning Self-Rating 
Residual 


2 
11 


58.00 .464 .640 
124.99 








ERJC 


Posttraining Self-Rating 
Residual 




2 
12 


127.54 2.283 
55.86 


.144 




9^ 








2! 





TABLE 5. Analyses of Variance for Repeated Measures Suimnary for Observed Monitoring of Seatwork 



Pretrainii.g 



Posttraining 



Sources of Variation 



Total 



df MS F p 



df MS 



Pretraining Self-Rating 
Residual 



3 451.33 6.735 .001 
34 67.01 



Posttraining Self-Rating 
Residual 

Elementary 



3 472.65 3.236 
36 146.07 



.033 



Pretraining Self-Rating 
Residual 

Posttraining Self-Rating 
Residual 

Junior High /Middle 

Pretraining Self-Rating 
Residual 

Posttraining Self-Rating 
Residual 

Secondary 

Pretraining Self-Rating 
Residual 



2 415.08 3.921 
9 105.861 



2 
9 



14.97 
44.23 



3 75.66 2.365 
10 31.99 



.060 



.339 .722 



.132 



3 
9 



191.84 
367.03 



.523 .677 



2 7.71 ..5S1 .579 
9 13.28 



Posttraining Self-Rating 
Residual 



2 
12 



4.76 
106.69 



.045 .957 



